A new technique for assessing glottal dynamics in speech and singing by means of optical-flow computation
نویسندگان
چکیده
The use of high-speed videoendoscopy (HSV) in combination with image-processing techniques is the most promising approach to investigate vocal-folds vibration and laryngeal dynamics in speech and singing. The current challenge is to provide facilitative and informative playbacks for clinical and research purposes. We present three new facilitative playbacks using an optical-flow framework (OF). Optical-flow techniques are widely used in the field of computer vision for tracking unidentified moving objects in video sequences. The application of OF computation to HSV images is investigated. The advantages, drawbacks, and the complementarity to existing methods are discussed. The method has been tested on a database of 60 HSV sequences which covers different voice qualities for spoken and sung vowels. The new data representations have been compared with commonly-used facilitative playbacks. They provide additional information on the temporal dynamics of glottal vibratory movements during glottal closing and opening phases.
منابع مشابه
Glottal spectrum based inverse filtering
In this paper a new inverse filtering technique for the timedomain estimation of the glottal excitation is presented. This approach uses the DAP modeling for the vocal tract characterization, and a spectral model for the derivative of the glottal flow. This spectral model is based on the spectrum of the KLGLOTT88 model for the glottal source. The proposed procedure removes the glottal source fr...
متن کاملSteady Flow Through Modeled Glottal Constriction
The airflow in the modeled glottal constriction was simulated by the solutions of the Navier-Stokes equations for laminar flow, and the corresponding Reynolds equations for turbulent flow in generalized, nonorthogonal coordinates using a numerical method. A two-dimensional model of laryngeal flow is considered and aerodynamic properties are calculated for both laminar and turbulent steady flows...
متن کاملComparison between single and double flow plane solar heaters considering gas radiation effect
ABSTRACT: In this paper, the thermal characteristics of single and double flow plane solar heaters with radiating working gas were analyzed and compared by numerical analysis for the first time. The laminar mixed convection gas flow in the heaters was numerically simulated by the CFD method using the finite volume technique. The set of governing equations included the conservation of mass, mome...
متن کاملSource-Filter Interaction in Speaking and Singing is Nonlinear
Many aspects of speech production have been successfully described by a linear sourcefilter theory. Linearity implies that the source-filter combination, which provides the acoustic output at the mouth, can be characterized by mathematical convolution in the time domain (or by multiplication in the frequency domain) of two independent functions representing the source and the filter. With this ...
متن کاملComputation Optical Flow Using Pipeline Architecture
Accurate estimation of motion from time-varying imagery has been a popular problem in vision studies, This information can be used in segmentation, 3D motion and shape recovery, target tracking, and other problems in scene analysis and interpretation. We have presented a dynamic image model for estimating image motion from image sequences, and have shown how the solution can be obtained from a ...
متن کامل